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Sv III 

Abstract 

p | . In this paper the asymptotic behavior of the conditional least squares (CLS) estimators 

^ en of the offspring means (at,/3) and of the criticality parameter g := a + j3 for a 2- 

type critical doubly symmetric positively regular Galton-Watson branching process with 

immigration is described. 

v^; 1 Introduction 

m ; 

OO \ Statistical inference for critical Galton- Watson processes is available only for single-type pro- 
cesses, see Wei and Winnicki [16] . [17] and Winnicki [18]. In the present paper the asymptotic 
! behavior of the CLS estimators of the offspring means and criticality parameter for 2-type criti- 
cal doubly symmetric positively regular Galton- Watson process with immigration is described, 
. ^ ! see Theorem 13.11 This study can be considered as the first step of examining the asymptotic 
behavior of the CLS estimators of parameters of multitype critical branching processes with 
, immigration. 

Let us recall the results for a single- type Galton- Watson branching process (Xk)kez + with 
immigration and with initial value X = 0. Suppose that it is critial, i.e., the offspring mean 
equals 1. Wei and Winnicki [16] proved a functional limit theorem X^ n > — > X as n — > 00, 
where := n~ 1 X\ nt \ i for t G M+, n G N, where LxJ denotes the (lower) integer part of 
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xGl, and (Xt)teR+ is a (nonnegative) diffusion process with initial value Xq = and with 
generator 

Lf(x) = m £ f(x) + \vtxf\x), f G C C °°(K + ), 

where m £ denotes the immigration mean, denotes the offspring variance, and C£°(]R+) 
denotes the space of infinitely different iable functions on R + with compact support. The 
process (Xt)teM.+ can & lso be characterized as the unique strong solution of the stochastic 
differential equation (SDE) 



dX t = m £ dt+ JV^X t + dW t , t e R+, 

with initial value X = 0, where (Wt)teu + is a standard Wiener process, and x + denotes 
the positive part of i6l Note that this so-called square-root process is also known as Feller 
diffusion, or Cox-Ingersoll-Ross model in financial mathematics (see Musiela and Rutkowski 
dH p. 290]). In fact, (W^X t ) 

tm+ is the square of a 4V^ 1 m e -dimensional Bessel process 
started at (see Revuz and Yor [TH XI. 1.1]). 

Assuming that the immigration mean m £ is known, for the conditional least squares 
estimator (CLSE) 

(Y Y \ - T< n k=iXk-i(X k -m £ ) 

Z^k=i A fc-i 

of the offspring mean based on the observations X±, . . . , X n , one can derive 

t> L %t d(X t — m £ t) 
n(a n (X 1 , . . . , X n ) - 1) — > — -j — as n oo. 

Jo x t dt 

(Wei and Winnicki [17] contains a similar result for the CLS estimator of the offspring mean 
when the immigration mean is unknown.) 

In Section |2] we recall some preliminaries on 2-type Galton- Watson models with immigra- 
tion. Section |3] contains our main results. Sections HI [51 16] and [7J contain the proofs. Appendix 
IA1 is devoted to the CLS estimators. In Appendix |B] we present estimates for the moments of 
the processes involved. Appendix O and |D] is for a version of the continuous mapping theorem 
and for convergence of random step processes, respectively. 



2 Preliminaries on 2-type Galton— Watson models with 
immigration 

Let Z + , N, K and M + denote the set of non- negative integers, positive integers, real numbers 
and non-negative real numbers, respectively. Every random variable will be defined on a fixed 
probability space (Q,A,F). 

For each k,j G Z + and i,£ 6 {1)2}, the number of individuals of type % in the k th 
generation will be denoted by X^i, the number of type i offsprings produced by the j th 
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individual who is of type i belonging to the (k — 1) generation will be denoted by Ck,j,i,e, 
and the number of type % immigrants in the k th generation will be denoted by Sk,i- Then 
we have 



(2-1] 



-Vi. 



i=l L^fc,i,i,2 



X, 



£fc,2 



fc G N. 



Here {X , £k '■ k, j E N, i E {1, 2}} are supposed to be independent, where 

fc > 2 . 

Moreover, {£^1 '■ k,j E N}, {^^2 '■ k,j E N} and {s^ :fceN} are supposed to consist of 
identically distributed random vectors. 

We suppose E(||£i,i,i || 2 ) < 00, E(||£ 1)li2 || 2 ) < 00 and E(||si|| 2 ) < 00. Introduce the 
notations 



:= E(£ 1)M ) E 
V Cl :=Var(£ liM )GM 2x2 



2 

+ • 



m €i rr Hz 



s2x2 



E(ei) G 



V. := i(V, + y* ) e ]R 2x2 , 



V £ := Var(s 1 ) G 



Note that many authors define the offspring mean matrix as mj . For k E Z+, let Tk 
irtXo^i,...,^). By(T2l]), 

(2.2) E(X fc I = ra^ + X fe _i i2 m €a + m £ = m € + m e . 

Consequently, 



E(X fe ) = m^E(X fc _ 1 ) + m £ , fc G N, 



which implies 
(2.3) 



fe-i 



E(X fc ) = E(X ) + ^m^m £ , fceN. 

i=o 



Hence, the offspring mean matrix plays a crucial role in the asymptotic behavior of the 

sequence (Xk)kez + - A 2-type Galton- Watson process (Xk)k& + with immigration is referred 
to respectively as subcritical, critical or supercritical if g < 1, £? = 1 or £> > 1, where g 
denotes the spectral radius of the offspring mean matrix (see, e.g., Athreya and Ney [TJ 

V.3] or Quine [H]). We will consider doubly symmetric 2-type Galton- Watson processes with 
immigration, when the offspring mean matrix has the form 



(2.4) 



:- 



a (5 
(3 a 
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Its spectral radius is g = a + /3, which will be called criticality parameter. We will focus only 
on positively regular doubly symmetric 2-type Galton- Watson processes with immigration, i.e., 
when there is a positive integer k G N such that the entries of m| are positive (see Kesten 
and Stigum [ID]), which is equivalent to a > and > 0. 

For the sake of simplicity, we consider a zero start Galton- Watson process with immigration, 
that is, we suppose Xq = 0. The general case of nonzero initial values may be handled in a 
similar way, but we renounce to consider it. In the sequel we always assume m £ ^ 0, otherwise 
X k = for all k G N. 



3 Main results 

We will use the notations 



it 



For each n G N, any CLS estimator g n (X 1 , . . . ,X n ) of the criticality parameter g based 
on a sample Xi, . . . , X n has the form 



(3-1) 



Qn(Xi, . . . , X n ) 



whenever the sample belongs to the set 
(3.2) 



H n := [(xi, . . . , x n ) G (M 2 ) n : ^(1, x k ^) 2 > V 
^ k=i * 





[X 1: . 


■ 9 X n ) 


1 


1 1 " 




Qn 


[X 1 ,. 


■ ■ j x n ) 




[X U .. 


■ , x n ) 


~ 2 


1 -1 






[X u . 


■ ■ , x n ) 



where x := is the zero vector in M?, see Lemma [A. II 

Moreover, for each n G N, any CLS estimator (a n (Xi, . . . , X n ), /3 n (Xi, 
offspring means (a, (3) based on a sample Xi, . . . , X n has the form 



(3.3) 

whenever the sample belongs to the set H n D H n , where 

(3.4) H n := |(aji,...,aj„) G 
and 

(3.5) 5 n (Xi, • • ■ ,-X" n ) : 



n2\n 



n . 

: ^2(u, x k ^) 2 > Ok 
fc=i ^ 



^ =1 (n, X fc - m £ ) (it, X fe _i) 



Efc=i( w > x fc-i> 2 



X n )) of the 
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see Lemma [A. 11 

In what follows, we always assume that (Xk)kez + is a 2-type doubly symmetric Galton- 
Watson process with offspring means (a, 0) £ (0, l) 2 such that a + /? = 1 (hence it is critical 
and positively regular), X = 0, E(||£ 1)lj:L || 8 ) < oo, E(||£ ljl)2 || 8 ) < oo, E(||ei|| 8 ) < oo, and 
m £ ^ 0. Then lim^^ F((X U . . . , X n j £ H n ) = 1. If {V $ u, u) > 0, or if (F 4 w,w) = 
and E((u, £i) 2 ) > 0, then lim^oo P((Xi, . . . , I n ) £ H n ) = 1, see Proposition lAJJ 

Let (yt)teR + be the unique strong solution of the stochastic differential equation (SDE) 



(3.6) dy t = (1, m e ) ti+yj (V* 1, 1) # dW tj t £ 

where (Wt)t 6 iR + is a standard Wiener process. 
3.1 Theorem. We have 



y = o, 



x) v jly t d{y t -{i,m e )t) 



n(g n (X u ...,X n ) - 1) 

Jo yf dt 



(3.7) 

// 1} = tfien 

(3.8) n s / 2 (ft,(X 1) ... ) X B )-l) Ajy/Yo,^ 



as n — >• oo. 



3( V £ 1, 1) 
m £ ) 2 



as n — y oo. 



J/ ( V^u, > #ien 
(3.9) 



n 1 /2(a n (Xi,... l X n )-a) 
n 1 / 2 n (X 1 ,...,X n )-P) 



v 



a(3 



fix** 



as n — y oo, 



where (yV t )tm+ is a standard Wiener process, independent from (Wt)tm+- 
If (V i u,u) = and E{(u,e 1 ) 2 )>0 then 



(3.10) 



• , X n ) - a) 



n 1 / 2 n (X 1 ,...,X n )-P) 



/ (V £ u,u) 

'4E«u, £l > 2 ) 



as n — y oo. 



3.2 Remark. If (V € u, u) > and (V € l, 1) = then in Q we have 



'a/3 



Jo^dt 



C AT(0,^a/3 



3.3 Remark. Note that the assumption (V^l, 1) = is fulfilled if and only if £1,1,1,1 + 
61,1,1,2 = 1 and £1,1,2,1 + 61,1,2,2 = 1, i.e., the total number of offsprings produced by an 
individual of type 1 is 1, and the same holds for individuals of type 2. Indeed, (V^l, 1} = 
((V €l l,l)+(V €a l,l»/2 = is fulfilled if and only if (V €l l,l) =0 and (V^l,l) = 0, where 
(V €i l,l> =E[(1,£ 1)M -E(£ W )) 2 ] = is equivalent to (l.&^-Efo^)) = (1,€ 1>M >-1 = 
for each i £ {1, 2}. 
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In a similar way, the assumption (V^u, u) = is fulfilled if and only if a = (3 = |, 
£1,1,1,1 £1,1,1,2 an d £1,1,2,1 = £1,1,2,2, i-e., the number of offsprings of type 1 and of type 2 
produced by an individual of type 1 are the same, and the same holds for individuals of type 2. 
Indeed, ( V^u, u) = ((V^w, u) + (V^u, w))/2 = is fulfilled if and only if (V^u, u) = 
and (V^ 2 u, u) = 0, where (V^.u, u) = E[(w, — E(^ ljl) j)} 2 ] = is equivalent to 
~ E (€i,i,i)) = («, £i,i,i) -(«-/?) =' for each i 6 {1, 2}, which imply a - /3 = 0, 
since P((w, dii) 6 Z) = 1, a — /3 G (—1,1) by the assumptions (a, (3) G (0, l) 2 and 
a + /3 = 1, and is the only integer in the interval (—1,1). 

Observe that the assumptions (Vgl, 1) = and (V^w, w) = can not be fulfilled at the 
same time. 

Remark that condition E(( , u,£ 1 ) 2 ) > fails to hold if and only if e ltl — £ li2 =' 0, and, 
under the assumption ( V^u, u) = 0, this implies X^i = Xk t 2 (see Lemma IA.3I) . when 
P((Xi, . . . , X n ) G H n fl if re ) = for all n G N, and hence the LSE of the offspring means 
(a, (3) is not defined uniquely, see Appendix [A] □ 

3.4 Remark. For each n G N, consider the random step process 

Theorem 15. II implies convergence (15.31) . hence 

(3.11) AT (rt) A * := -^1 as n^oo, 

where the process (3 / t)teR+ is the unique strong solution of the SDE (13. 6p with initial value 
3^o = 0. Note that convergence (13.111) holds even if (Vgl, 1) = 0, when the unique strong 
solution of (13. 6ft is the deterministic function y t = (l,m e )t, t G R+. In fact, convergence 
(13. lip is a special case of the main result in Ispany and Pap (71 Theorem 3.1]. Indeed, the 
Perron vector of the offspring mean matrix is u — |l, and the unique left eigenvector 

v corresponding to the eigenvalue 1 of with u v = 1 is v — 1. 

The SDE (I3.6P has a unique strong solution (3 ; ( S/ ' ) )t 6 R + for all initial values = y G K, 
and if y ^ 0, then y[ y) is nonnegative for all t G K+ with probability one, hence yf may 
be replaced by y t under the square root in (I3.6p . see, e.g., Barczy et al. [31 Remark 3.3]. □ 

3.5 Remark. We note that in the critical positively regular case the limit distributions for 
the CLS estimators of the offspring means (a, 0) are concentrated on the line {(u, v) G M 2 : 
u + v — 0}. In order to handle the difficulty caused by this degeneracy, we use an appropriate 
reparametrization. Surprisingly, the scaling factor of the CLS estimators of (a, j3) is always 
y/n, which is the same as in the subcritical case. The reason of this strange phenomenon can 
be understood from the joint asymptotic behavior of the numerator and the denominator of 
the CLS estimators given in Theorems I4.1[ 14.21 and 14.31 The scaling factor of the estimators of 
the criticality parameter g is usually n, except in a particular special case of (V^l, 1) = 0, 
when it is n 3//2 . One of the decisive tools in deriving the needed asymptotic behavior is a good 
bound for the moments of the involved processes, see Corollary IB. 71 □ 
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3.6 Remark. The shape of f Q 3^d(X — (l,m e )t)/ J y? dt in (13. 7p is similar to the limit 
distribution of the Dickey-Fuller statistics for unit root test of AR(1) time series, see, e.g., 
Hamilton (5j 17.4.2 and 17.4.7] or Tanaka [TBI (7.14) and Theorem 9.5.1]. The shape of 
J^ytdWt/ J^y t dt in ( 13. 9 p is also similar, but it contains two independent standard Wiener 
processes. This phenomenon is very similar to the appearance of two independent standard 
Wiener processes in limit theorems for CLS estimators of the variance of the offspring and 
immigration distributions for critical branching processes with immigration in Winnicki [T8~| 
Theorems 3.5 and 3.8]. Finally, note that the limit distribution of the CLS estimator of the 
criticality parameter g is non-symmetric and non- normal in (13.71) . and symmetric normal in 
(13.81) . but the limit distribution of the CLS estimator of the offspring means (a, (3) is always 
symmetric, although non-normal in ( 13. 9p . Indeed, since (Wt)te'R+ and (Wt)tm + are indepen- 
dent, by the SDE (13.61) . the processes ([Vt)teK + an d (yVt)tm+ are a ls° independent, which 
yields that the limit distribution of the CLS estimator of the offspring means (a, 0) in (13.91) 
is symmetric. □ 

3.7 Remark. We note that an eighth order moment condition on the offspring and im- 
migration distributions in Theorem 13.11 is supposed (i.e., we suppose E(||^ 1;L1 || 8 ) < oo, 
^(ll£i l 2II 8 ) < 00 an d E(||£i|| 8 ) < 00). However, it is important to remark that this con- 
dition is a technical one, we suspect that Theorem 13.11 remains true under lower order moment 
condition on the offspring and immigration distributions, but we renounce to consider it. □ 



4 Proof of the main results 

Applying (12. 2p . let us introduce the sequence 

(4.1) M k := X k - E{X k I JVi) = X k - m^X^ - m e , fcGN, 

of martingale differences with respect to the filtration (J r fc)fc 6 z+- By (14.11) . the process 
(X k ) ke z + satisfies the recursion 

(4.2) X k = m^Xn + m £ + M k , keN. 
Next, let us introduce the sequence 

U k := (1, Xk) = X kt i + X kj2 , k G Z + . 
One can observe that U k ^ for all k G Z + , and 

(4.3) U h = U k - 1 + (l,m e ) + (l,M k ), keN, 

since (1, m^X k _i) = l T m^Xfc_ 1 = l T X k _i = U k -i, because g = a + (3 = 1 implies that 1 
is a left eigenvector of the mean matrix belonging to the eigenvalue 1. Hence (U k ) k£ z + 
is a nonnegative unstable AR(1) process with positive drift (1, m e ) and with heteroscedastic 
innovation ((1, M k )) ke -^. Moreover, let 

\4 := (u, X k ) = X kj i - X k ,2, k G Z + . 
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Note that we have 



(4.4) 



V k = {a - p)V k -.! + (u, m £ ) + (u, M k ), keN, 



since (u, m^Xk-i) = u T m^Xk^i = (a — (3)u T X k _i = (a — (3)V k -i, because u is a left 
eigenvector of the mean matrix belonging to the eigenvalue a — (3. Thus (V k ) ke ^ is a 
stable AR(1) process with drift (u,m e ) and with heteroscedastic innovation ((u, M k )) k€ ^. 
Observe that 



(4.5) 



X kA = (U k + V k )/2, X k<2 = (U k - V k )/2, 



k e Z+. 



By f)3.ip . for each n G N, we have 

Qn\S*- 1; • • • ) n) 1 TT2 ' 

Z^k=l U k-l 

whenever (Xi, . . . , X n ) G H n , where H n , n G N, are given in (13. 2p . By A3. 5j) . for each 
n6N, we have 



(4.6) 



1) 



X n ) - 5 



Z^fc=i v k-\ 

whenever (Xi, . . . , X n ) G if n , where n G N, are given in (13. 4p . 

Theorem 13.11 will follow from the following statements by the continuous mapping theorem. 

4.1 Theorem. We have 



E 

fc=i 



n- 2 (l,M k )U k ^ 



v 



4.2 Theorem. // (V € l, 1) = t/ien 



E 



n- 3 / 2 (l,M i )^i 
n- 3 / 2 <«,M fc )y fc _ li 



J 1 y t d(}' t -(l ) m e >i) 



JO ^* u ^ ,/ * 



as n — >• oo. 



as n — >■ oo, 



where (Wt)teR+ ^s a standard Wiener process, independent from (Wt)t£R + and (Wt)tm+- 
Note that (3^)teR + now t/ie deterministic function y t = (l,m £ )t, t G hence 

fiy?dt = {l,ni e } 2 /3, fiy t dt = (l,m e )/2, fiy t dW t = (l,m e ) fitdW t and fiy t dW t = 
(l,m e ) /otdWt. 



S 



4.3 Theorem. If (V^u, u) = then 



E 

fc=i 



n- 2 (l,M k )U k „ 
u, M k )V k . 



'1/2, 



V 



E((S,s 1 ) 2 ) 

fiy t d(y t -(i,m K )t) 

[(V e u,u)E((u,e 1 ) 2 )] 1 / 2 Wi 



as n — > oo. 



5 Proof of Theorem 14.1 



Consider the sequence of stochastic processes 



r{n) 



(n) 
k 



with 



■(n) 



k=l 



n~ l M k 
n~ 2 M k U k ^ 
n-^ 2 M k V k . x 



-i 



n l U k _ x 
n^V k ^ 



M k 



for t G M + and fc, n G N, where £g> denotes Kronecker product of matrices. Theorem 14.11 
follows from Lemma [A.2I and the following theorem (this will be explained after Theorem 15. ip . 



v 



5.1 Theorem. We have 

(5.1) Z {n) ^ Z as n -> oo, 

where the process (Z t ) t£R+ with values in (M 2 ) 3 is the unique strong solution of the SDE 

'd\Vt 



(5.2) 



dZ t = 7 (t, Z t 



t G 



with initial value Z = 0, where (Wt)tm+ an d (Wt)teR + are independent 2- dimensional 



standard Wiener processes, and 7 : IR + x 

(l,(x 1 + tm e )+) 1 / 2 

l{t,x) : 



>2\3 



— >■ 



)2x2\3x2 



is defined by 



for t G M+ and cc = (aii, cc 2 , #3) G 



(l,(x 1 +tm £ )+) 3 / 2 


2\3 








<^y /2 <l,*i+*"0 



.-1/2 



(Note that the statement of Theorem 15.11 holds even if (V^u, u) = 0, when the last 2- 
dimensional coordinate process of the unique strong solution (Z t ) t£WL+ is 0.) 

The SDE ([22D has the form 

(l^Mt + tm^y^VfdWt 
(l,(M t + tm £ y)^vl /2 dW t 





~dM t ~ 




dZ t = 


dAf t 






dV t _ 





1/2 (l^Mt + tm,) v\ /2 dW t 
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Ispany and Pap [7] proved that the first 2-dimensional equation of this SDE has a unique strong 
solution (Ai t )tm+ with initial value Ado = 0, and (Ad t + tm e ) + may be replaced by 
Ad t + tm e (see the proof of [TJ Theorem 3.1]). Thus the SDE (I5.2p has a unique strong solution 



with initial value 


Z ~- 


= 0, 




Mt 




z t = 


Aft 






v t 





f (1, Ad t + tm e ) dAd s 



4a/3 



/ r (l,M t + tm e ) V/ dW s 



i g 



By the method of the proof of X^ X in Theorem 3.1 in Barczy et al. [3], applying 
Lemma IC.2t one can easily derive 



(5.3) 
where 



- X {n)- 


V 


'x 




z (n) 




as n — )• oo 




z 





X 



[nt\ , 



X t :=-(!, Mt + tm e )l, te 



More precisely, using that 



iiGN. 



ken, 



we have 



z {n) 

2\3^ 



^«(2 (n) ), nGN, 



where the mapping ifj n : D(R + , (R 2 ) s ) — >• D(R + , (M 2 ) 4 ) is given by 



AW 
/*(*) 

/s(*) 



for fx, f 2 , f 3 G D(R+, M 2 ), t G K+, n G N. Further, we have 



X 

z 



where the mapping ip : D(R+, (M 2 ) 3 ) D(M+, (M 2 ) 4 ) is given by 

~±(l,A(t)+tm e )l" 



hit) 
h{t) 

hit) 
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for fx, f2, /3 G D(M + ,]R 2 ) and i G R+. By page 603 in Barczy et al. [3], the mappings if) n , 
nGN, and ^ are measurable (the latter one is continuous too), since the coordinate functions 
are measurable. Using page 604 in Barczy et al. [3], we obtain that the set 



C := {/ G C(R+, (M 2 ) 3 ) : /(0) = G (M 2 ) 3 } 



has the properties C C C, 



with C G B(D(I 



)) and P(S G C) = 1, where 



l/>,(V>n)ngN 



is defined in Appendix O Hence, by (15. 1 j) and Lemma IC.2[ we have 



as desired. 

Now, with the process 



x 

z 



as n — y oo, 



X := (l,AT t ) = (l,M t + tm e ), te 



we have 



AT, 



t G 



By Ito's formula we obtain that the process (yt)tm+ satisfies the SDE (13. 6p . 

Next, similarly to the proof of (1A.6I) . by Lemma IC.31 convergence (15.31) and Lemma IA.2I 
;i,X fc _i) implies 



with U. 



k-l 



k=l 



n~ 2 (l,M k )U k ^ 
n^/ 2 (u, M k )V k ^\ 



v 



^) 1/2 /:^d(^; /2 w t ) 



as n — > oo. 



This limiting random vector can be written in the form as given in Theorem l4.lt since (1, X t ) = 
y t , (l,M t ) = {l,X t )-(l,m e )t = y t -(l,m e )t and (u, V^^Wt) = (V^u, u) 1/2 W t for 
all t G R+ with a (one-dimensional) standard Wiener process (Wt)teu + - 

Proof of Theorem 15.11 In order to show convergence Z^ Z, we apply Theorem lD.il 



with the special choices li 



Z, U 



(n) 



Zf, n,k G N, (H n ')kez + 



and 



the function 7 which is defined in Theorem 15.11 Note that the discussion after Theorem 
15.11 shows that the SDE (I5.2p admits a unique strong solution (Z^) t£ ^ + for all initial values 



^0 



z G 



p2\3 



Now we show that conditions (i) and (ii) of Theorem ID.ll hold. The conditional variance 
has the form 



E(Z 



(n)/ 7 (n)\T 



n 3 U k -! 



n 
-37 



E(M fc Mj I JF k -i) 



11 



for nGN, k G {1, . . . ,n}, and 7(5, Z^ ) )^{s, Zf>y has the form 



(1, Mf ] + sm e ) (1, + sm £ ) 
(1, M { J l) + sm £ ) 2 (1, Mi n) + sm £ ) 








^(1,MW + S m £ > 2 



for s G R+, where we used that (1, M^ l) + sm £ ) + = (1, M.^ + sm £ ), s G R+, nGN. 
Indeed, by Q4.ip . we get 



[nsj 

1, A<i n) + sm £ ) = - X fe - m c X fc _! - m e ) + (1, sm £ ) 



(5.4) 



fc=i 

[nsj 



- X fe - X fc _i - m e ) + s(l, m e ) 

n z — ' 

fc=i 



1 ,„ „ , — I ns \ . . 1 ns — Ins J 

n n n 



n 



Xrn e ) 



for s G E + , nGN, since l T m^ = 1 T implies (l,m^X fc _ 1 ) = l T m^X fc „! = l T X fc _! 

(1, **-!>■ 

In order to check condition (i) of Theorem lD.il we need to prove that for each T > 0, 

[nt\ 



(5.5) 



sup 

te[o,T] 



(5.6) sup 

te[o,T] 



(5.7) sup 

te[o,T] 



(5.8) sup 

te[o,T] 



(5.9) 



(5.10) 



1 l™J /.t 

n Jo 
— "TUk^EiMkMjl J-fc-i)- / (l,Mi n) + sm e ) 2 V $ d S 

n fc=l ^ 

fc=i ^ ^° 

Lntj 

g^^iE(M fc Mj|.F*-i) 



0. 



sup 

*e[o,T] 



sup 

*e[o,T] 



fe=l 

LntJ 



k=l 



as n — > 00. 

First we show (I53|l . By fl5T4j) . 



f <1, M« + S m £ ) ds = 1 ^ 17, + ^[/ M + 
Jo n k=l n 



[nt\ + (nt - \ nt\)' 
2^ 



(l,m £ ). 
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Using Lemma IB.lt we obtain 

\nt\ \nt\ 

k=l k=l 

\nt\ \nt\ 

= £ U k -xV i + Vu-i(V €l - Vs 2 ) + [nt\ V e . 

k=l k=l 

Thus, in order to show (15.51) . it suffices to prove 

LnTj 

(5.11) „-a £ -2* 0, 

k=l 

(5.12) n~ 2 sup U lnt} AO, 

*6[0,T] 

(5.13) n~ 2 sup [[ntj + (rat - L^J) 2 ] ->■ 

te[o,T] 

as n -> oo. Using (lR5j) with £ = 2, i = 0, j = 1 we have (15TTD . Using (lB~6l) with £ = 2, 
i = 1, j = 0, we have (15TT2"]) . Clearly, (ETT31) follows from |nt - [rzij | ^ 1, neN, t G R+, 
thus we conclude (I5.5p . 

Next we turn to prove (15. 6p . By (j5.4j) . 



/n ft ft Tl 

Jl) fc=i fc=i 



(nt-lntl) 2 , , rr I nil + (nt - In/J) 3 .„ 
+ - l r M - (l,m s )U lnt] + ^ Q 3 (l,m £ y 

n A on 6 



Using Lemma |B.1[ we obtain 



\nt\ \nt\ 

Uk-i E(M fc Mj | JU) = U k-i [Xk-i^V^ + X fc _ li2 V i2 + VJ 

k=l k=l 

(5.14) 

|n.tj |n*J l nt \ 

= E + 2 E - n 2 ) + E 

fc=i ^=1 fe=i 
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Thus, in order to show (15.61) . it suffices to prove 





[nT\ 




(5 15) 


n~ 3 \UkVh\ - 

fc=l 


p 

— > 




LnTj 




(5. lb ) 


^-3 TT P 

n k — 


> 0, 




k=l 




(5.17) 


n~ 3/2 sup U [nti 


IP 




te[o,T] 




(5.18) 


n~ 3 sup [L n ^J + (nt — 
te[o,T] 


[ntj ) 3 ] -> 



as n — >■ oo. Using (1B.5|) with £ = 2, i — 1, j = l and £ = 2, i = 1, j = 0, we have (15. 15[) and 
(I5.16p . respectively. By (1B.8|) . we have (I5.17p . Clearly, ( 15 . 1 8 j) follows from \nt — \nt\\ ^ 1, 
iiGN, t G K+, thus we conclude (15. 6p . 

Now we turn to check (15. 7p . Again by (15. 4p . we have 

t [nt\-l [nt\~l [nt\-l 

/ (l,M^ + sm £ rds = - £ t/| + — (l,m.) E f/ 2 + ^(l,m £ > 2 £ ^ 

>/o fe=l fc=l k=l 

Mt/3 I 3(rat ~^j) 2 2 

4 Lre * J 2n 4 X 1 ' m e/^LntJ 



nt 
+ — 



7? 1 



+ ^ (l,m e ) t/ LntJ + ^ (l,m e ) . 

Using Lemma [B.H we obtain 

E UU E(M k M r k | JVx) = U Li [Wfe + ^-i,2^ 2 + V.] 
fc=i fe=i 

(5.19) 

[nt] L™*J L* 1 *] 

= E + 2 E ^-i^-^^ - + E ^ v - 
fe=i fc=i fe=i 



ii 



Thus, in order to show (15.71) . it suffices to prove 

[nT\ 



(5.20) 
(5.21) 

(5.22) 

(5.23) 
(5.24) 



n 



k=l 



E \w>\ ^ °. 

=i 

[nTJ 
k=l 



n 



\nT\ 

*;=i 



n 4/3 sup t/ Lrit j — > 0, 
te[o,T] 

n -4 sup [[nt\ + (nt- \nt\Y] -» 
*e[o,T] 



as n ->■ oo. Using (IB.5|) with £ = 4, z = 2, j = 1, £ = 4, z = 2, j = 0, and £ = 2, i = 1, 
j = 0, we have fl5T20|) . f[5^Tj) and fl532|) . respectively. By f lB~8|) . we have (Q3")l . Clearly, 
(I5.24p follows again from |nt — \nt\ | ^ 1, n G N, t 6 JR+, thus we conclude (15. 7(1 . 

Next we turn to prove (EH}. By fQ4"jl . (05]) and fOHjl we get 



(5.25) 



n sup 

*e[o,T] 



|nt| [nt] 

E U k -i E(M*MJ | - E E^_! V € 
fc=i fc=i 







as n-yoo for all T > 0. Using (15. 6ft . in order to prove H 5 . 8 (1 . it is sufficient to show that 



(5.26) 



n sup 

*6[0,T] 



[nt\ 



E n-i E(M fc Mj | JV 



fc=i 



4a/3 



LntJ 



fc=i 



as n-foo for all T > 0. As in the previous case, using Lemma IB.1[ we obtain 



(5.27) 



[nt\ [nt\ 

E Vt-i HM k Ml I J- fe _ x ) = J2 K-i [Xk-x,iV $1 + x fe _ ll2 ^ 2 + v.] 

k=l k=l 

\nt\ [nt] \nt\ 

= E ^-i^-i^ + o E - v <*) + E 



fc=i 



k=l 



k=l 



Using (IB .5(1 with I = 6, z = 0, j = 3 and £ = 4, z = 0, j = 2, we have 



ii 



\nT\ 

- 3 Ei^i 3j ^ ' 
/c=i 



\nT\ 

E^ 2 



-3 \ t t-2 If ^ 

n y Vu — > (J as n — > oo, 



fc=i 
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hence (I5.26P will follow from 
(5.28) 



n sup 

te[o,T] 



[nt\ — „. [ntj 



fc=i 



/c=i 



as n — >• cx) 



for all T > 0. 



The aim of the following discussion is to decompose X^i=i Uk-iV^i — - - X/£ = j f^fe— i 
as a sum of a martingale and some negligible terms. Using recursions (14. 4p . ( 14. 3f) and formulas 
flRT]) and flR2l . we obtain 

E(t/ fe _ 1 y fc 2 _ 1 1 J- fc _ 2 ) = E(([/ fe _ 2 + (1, M fc _x + m e » ((a - /3)U fc _ 2 + (u, M k ^ + m £ » 2 1 J- fc _ 2 ) 

= (a - P)*U k -. 2 V?_ 2 + u T E(M fc _ 1 Mj_ 1 1 J- fc _ 2 )£ f/ fe _ 2 
+ constant + linear combination of [4_ 2 Vfc_ 2 , Vj?_ 2 , £4- 2 and V^_ 2 

= (a — /3) 2 £4_ 2 V fc 2 _2 + (V^u, it) £/ 2 _ 2 + constant 
+ linear combination of C4_ 2 T4_ 2 , V r fc 2 _ 2 , t4_ 2 and Vfc_ 2 . 



Thus 



LntJ L n *J l nt \ 

fc=l fc=2 



fc=2 



LntJ 



LntJ 



LntJ 



J2 [Uk-iK.! - E([4_iV r fe 2 _ 1 1 JV2)] + (a - /3) 2 £ f/ fc - 2 n 2 _2 + (V € 5, u) U, 



2 

fc-2 



fc=2 



fc=2 



fc=2 



+ O(n) + linear combination of ^ £4- 2 Vfe_ 2 , V^V^, ^ Z7 fe _ 2 and ^V fe _ 2 . 



fc=2 



fc=2 



fc=2 



fc=2 



Consequently, 

LntJ 



LntJ L«*J 
fc=l ^ P ' fc=2 



+ 



(a-/?) 

(Vjjytt) 

l-(o<-/3) : 



k=2 
LntJ 



fc=2 



(«-/9) 2 

-{a-py 



^Lntj-i^ 2 4j _ 1 + 0(rt) 



LntJ L n *J L«*J l nt \ 

+ linear combination of ^^£4_ 2 Vfc_ 2 , YjV^, £4_ 2 and Vfc-2- 



fc=2 



fc=2 



Using (IB.7P with £ = 8, i = 1 and j = 2 we have 



n sup 

te[o,T] 



LntJ 



fc=2 



fc=2 



as n — > oo. 



k=2 
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Thus, in order to show (15.281) . it suffices to prove 

[nT\ 



(5.29) 
(5.30) 
(5.31) 

(5.32) 

(5.33) 
(5.34) 



n 



k=l 



n 



n 



n 



\nT\ 

k=l 
\nT\ 



k=l 
\nT\ 



£ini-^o, 



k=l 



n 3 sup f/ L „tjV L 2 ntJ 
te[o,T] 



n 



-3/2 



SUp f/ L niJ > 



te[o,T] 



as n ->■ oo. Using (JR5]) with £ = 2, i = 1, j = 1; £ = 4, i = 0, j = 2; £ = 2, i = 1, j 
and £ = 2, i = 0, j = 1, we have (EZSj) , ( CTD . (15311 and ( 15321) . Using flEE} with £ 
i = 1, j = 2 we have (15331 . By (lR8j) . we have (I534j) . Thus we conclude (I53j) . 

For (15.91) . consider 



(5.35) 



[nt\ [nt\ 

V k -i E(M fc Mj | F k _ x ) = V k -i [X k -i,iV^ + X fc _ lj3 V €a + V e ] 
fe=i fc=i 

[ntj |n*J L n *J 



k=l 



k=l 



k=l 



where we used Lemma IB. It Using (1B.5I) with 
we have 



4, % = 0, j = 2, and i = 2, z = 0, j = 1, 



n 



[nT\ 
5/2 TA2 



fc=i 

hence (15. 9p will follow from 
(5.36) 



n 



[nTj 

fc=i 



as n — >■ oo, 



n 5 / 2 sup 
te[o,r] 



LntJ 



k=l 
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The aim of the following discussion is to decompose ^fc-i^fc-i as a sum of a martingale 

and some negligible terms. Using the recursions f)4.4p . ( 14. 3 p and Lemma [B.l[ we obtain 

= E((C/ fe _ 2 + (1, M fc _! + m £ )) ((a - /3)V k „ 2 + (u, M k _ x + m e » | T k .^ 
= (a- l3)U k - 2 V k -2 + {u,m e )Uk-2 + (a - ra e )T4_ 2 + l T m e mJw 

= (a — 0)Uk- 2 V k - 2 + constant + linear combination of U k - 2 and Vfc_2- 



Thus 



\nt\ \nt\ \nt\ 

fc=l fc=2 fc=2 



[nt\ 



[nt] 

a - f3)J2u k . 2 V k - 2 



k=2 



J2 [Uk-iVk-i - Epk-iVk-! | T k -2 

k=2 

+ 0(n) + linear combination of £4-2 an d Vfc_ 2 



fc=2 



fc=2 



Consequently 



\nt\ \nt\ 

u k-iVk-i = _ 7 —ox - E(tf fc -iV fc -i 1 7- fc _ 2 )] 

*•— 2 ^ ^' A— 2 



a — /3 



C/Lntj-iVLntj-i + O(n) + linear combination of ^ C4_ 2 and ^ Vfc_ 2 . 



1 - (a - /3) 

Using (IB. 71) with £ = 4, z = 1 and J = 1 we have 



k=2 



k=2 



n 5 ^ 2 sup 
te[o,T] 



[nt\ 



[Uk-iVk-i - E(f/ fe _ 1 T4_ 1 1 J- fc _ 2 



fc=2 



as n — > oo. 



Thus, in order to show ( 15.361) . it suffices to prove 

\nT\ 

(5.37) n" 5 / 2 ^(/ k Afl, 



fc=i 

\nT\ 



(5.38) 
(5.39) 



n" 5 / 2 sup \U Vntl V Vntl \ ^0 



-5/2 



£ w o. 



fe=i 



te[o,T] 
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as n — > oo. Using flB.5j) with I = 2, i = 1, j = 0, and £ = 2, i = 0, j = 1, we have ( I5.37P 
and (I5.38p . Using flB.6j) with £ = 3, % = 1, j = 1 we have (I5.39p . thus we conclude ( 15. 9p . 

Convergence (I5.10p can be handled in the same way as (15.91) . For completeness we present 
all of the details. By Lemma IB.lt we have 



(5.40) 



\nt\ \nt\ 

E Uk-iV k -i E(M 2 k | Tk-x) = E Uk-iVk-x [X k -i,iV^ + X k . lfl V ia + Vj 
k=i k=i 



[nt\ 



[nt\ 



fe=l fc=l fc=l 

Using (IB. 51) with £ = 4, i = 1, j = 2, and £ = 2, z = 1, j — 1, we have 



LnTj 



-7/2 



E o, 



n 



-7/2 



E 1^-1^4- 



as n-^oo, 



fc=i 



fc=i 



hence (15.101) will follow from 
(5.41) 



n 7 ^ 2 sup 
te[o,T] 



E^ 2 -i^ 



fe=l 



as n — > oo. 



The aim of the following discussion is to decompose Ylk^i ^f-iH-i as a sum °f a martingale 
and some negligible terms. Using recursions (I4.4p . ( 14. 3 p and Lemma [B.lt we obtain 

E(t^_ 1 y fc _i | T h - 2 ) = E((t/ jfe _ 2 + (1, M fc _x + m e )) 2 ((a - (3)V k ^ 2 + (5, M fe _x + m«» | J^ 2 ) 

= (a — /3)[/|_ 2 Vfc_2 + constant 
+ linear combination of t4_ 2 , Vfc_ 2 , U%_ 2 , V k 2 _ 2 and £4_ 2 Vfc_ 2 . 

Thus 



[nt] [nt] \nt\ 

UUV k -i = E [Uk-iVk-i - mLiVk-i I JV-a)] + E E (^ 2 -i^-i I JV-a) 

fe=l fc=2 fc= 2 



[ntj |n*J 

E K-iVk-! - miiV k -i i j- fe - 2 )] + (« - p) E ^ 2 -2^-2 + o( 



n 



k=2 



k=2 



\nt\ [nt\ [nt\ [nt] [nt\ 

+ linear combination of ^^£4_ 2 , E^^4-2 ; E/^ 2 - 2 ' ^4-2 an d ^4-2^ 

fe=i fc=i fc=i it=i fc=i 



fc-2- 
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Consequently 



\nt\ \nt\ 



fc=i 



k=2 



a — (3 



^„ tJ _iV Ln *j-i + 0(n) 



[nt\ [nt\ [nt\ [nt\ [nt\ 

+ linear combination of ^E/ fc _ 2 , ^JVfe_ 2 , ^ ^f_ 2 , ^ V fc 2 _ 2 and E4_ 2 Vfc_ 2 . 

fc=l fe=l fc=l fe=l k=l 

Using (IB.7P with I = 8, i = 2 and j = 1 we have 



n 7 ^ 2 sup 
te[o,T] 



^ [UUVu-x - E(t£_iVfc-i I ^ fc -2 



fc=2 



Thus, in order to show (15.411) . it suffices to prove 

\nT\ 



(5.42) 



(5.43) 



n 



fc=i 

LnTj 

fc=i 



as n — y oo. 



(5.44) 

(5.45) 

(5.46) 
(5.47) 



LnTj 



-7/2 



E W A o, 



fe=l 



n 



LnTj 
-7/2 T, 



fe=i 

LnTj 



n 



-7/2 



k=l 



n 



-7/2 



sup \Uf ntl V [r , 
*e[o,T] 







as n -> oo. Here flg22) , (OS]) . (J53U), (jS^I and ( 15^]) follow by (JHUD, and fl5^7|) by (El, 
thus we conclude (15.10j) . 

Finally, we check condition (ii) of Theorem ID. 11 i.e., the conditional Lindeberg condition 



LnTj 



(5.48) E E (H Z i n) ll% 



{\\zV>\\>0} 



Fk-i) for all > and T > 0. 



fc=i 



We have E (||Z^|| 2 l {||zr)||>e} 



^0- 2 E(||Z< n) || 4 | and 
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Hence 



\nT\ 

E (HZ^fl ( „) ) ^ as n -> oo for all 9 > and T > 0, 



\>e} 

k=l 



since E(||M fc || 4 ) = 0(k 2 ), E^M^U^) ^ x /E(||M fe || 8 ) E^) = 0(A; 6 ) and 



EdlMfeU 4 ^) < ^/E(||M" fc || 8 )E(V fc 8 _ 1 ) = 0(k 4 ) by Corollary EH Here we call the atten- 
tion to the fact that our eighth order moment conditions E(||^ x n|| 8 ) < oo, E(||^ x 12 || 8 ) < oo 
and E(||ei|| 8 ) < oo are used for applying Corollary IB. 71 This yields (15. 48 p . □ 



6 Proof of Theorem 4.2 



This is similar to the proof of Theorem 14.11 Consider the sequence of stochastic processes 

[nt\ 



r(") ._ 



: =E Z 



k 



with 



k=l 



n-V 2 {l,M h )U h ^ 
n^' 2 M k V k ^ 



for t G R + and k,nEN. Theorem 14.21 follows from Lemma IA.2I and the following theorem 
(this will be explained after Theorem 16.11) . 



6.1 Theorem. // (V € l, 1) = then 
(6.1) Z {n) 

where the process (Z t ) te ^ + with values 
SDE 



in 



as n — > oo ; 



xlxl 2 is the unique strong solution of the 



(6.2) 



dZ t = 7 (t, Z t 



dVVt 



t e 



with initial value Z = 0, where (\Vt)tm+> (Wt)tm+ an d (Wt)tm+ are independent 
standard Wiener processes of dimension 2, 1 and 2, respectively, and the function 7 : R + x 
(R 2 xKx R 2 ) -> R 5x5 is defined by 



j{t, x) 



{l,(x 1 +tm £ ) + ) 1 / 2 Vl /2 

(V e l,l) 1/2 (l,m e )t 







^) 1/2 (l,x 1 + trn £ )vl /2 



for t G M+ and x — (x\, X2, X3) G 



I 2 x R x IR 2 . 
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As in the case of Theorem 14.11 the SDE (I6.2p has a unique strong solution with initial value 
Z$ = 0, for which we have 



M t 



(V(U,u) 



1/2 



4c* 1 Jj^Vf dW. 

where now (V^l, 1} = yields y t = (l,m e )t, t G K+. One can again easily derive 
(6.3) 



t G 



' X {n)' 


V 


'x 




z (n) 




as n — > oo 




z 





where 

X { ! l) := n- l X 



\nt\i 



X t := ~(l,M t + tm e )l= ~(l,ra e )l, t G 1R+, n G N, 



since Af t = §3^1 = m e )l, £ G R+. Next, similarly to the proof of ( 1A.6I) . by Lemma [C73 
convergence (16.31) and Lemma IA.2I with U k -i = (l,Xk-i) imply 



£ 

fc=i 



n- 3 / 2 {l,M k )U k ^ 
_n" 3 / 2 (u, M fc >y fc _i. 



f l (i,x t ydt 

(^) Jo <*> 



Jo 

^) 1/2 /o 1 ^d(«,vfm) 



as n — >• oo. 



This limiting random vector can be written in the form as given in Theorem 14 . 2 1 since (1, X t ) = 
y t = (1, ra e ) t, and (it, V^Wt) = (V^u, it) 1 / 2 W t for all t G M+ with a (one- dimensional) 
standard Wiener process (Wt)teR+- 

Proof of Theorem 16.11 Similar to the proof of Theorem 15.11 The conditional variance has 
the form 



E(Z^(zf) T |^-i) 



n~ 2 V Mk n-^ 2 U k ^V Mk l n 

n-V 2 U k ^l T V Mk n- 3 U 2 k ^l T V Mk l n~ 3 U k ^V k ^l T V Mk 
n~^ 2 V k ^V Mk u^U^V^Vm^ n- 3 V 2 _ 1 V Mk 



- 5/2 v k ^v Mk 



for n6N, fee{l,...,n}, with V Mk ■= E(M fe Mj | JF^), and 7 (s, ^ n) ) 7 (s, ^ n) ) T has 
the form 










(V £ l,l)(l,m £ } 2 s 2 

^(1,MW+ S m £ f^ 
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for s G M+. 

In order to check condition (i) of Theorem lD.il we need to prove only that for each T > 0, 

[nt\ 

n 5/2 



(6.4) 
(6.5) 
(6.6) 



sup 

te[o,T] 



\nt\ 



fc=i 



0. 



sup 

te[o,T] 



^y)C^_ 1 l T E(M fc Mj|J- fc _ 1 )l- / (V e l,l)<l,m e ) 2 s 2 da 

n fc =i 70 

— £ C4_iT4-il T E(M k Mj | J- fc _0 



0. 



sup 

te[o,T] 



fc=i 



as n — >• oo, since the rest, namely, ()5.5p . (I5.8P and f 15 . 9 j) have already been proved. 

Clearly, (Vgl, 1) = implies (V 6l l,l) = and (V €a l,l) = 0. For each i e {1,2}, 
we have (V $ .l,l) = l T V ti l = (V^ 2 1) T (V^ 3 1) = ||V^ 2 1|| 2 , hence we obtain V^l = 0, 
thus V^.l = V^ 2 (V^ 2 1) = 0, and hence l T V ti = 0. 

First we show flfTi]) . By (l5TT4|) . 

[ntj |n*J 

E E(M t M[ | JF k _ x ) = E U k ^l T V e , 

k=l k=l 

hence using (IB. 51) with I = 2, i = 1, j = 0, we conclude (16.41) . 
Now we turn to check 1KT5]) . By (15TT9D . 

[nij LrxiJ [n*J 

^f/|_ 1 l T E(M fc MT 1^)1 = X)^! 1 ^' 1 = E^-i^ 1 ' 1 )' 

fc=i fc=i 

hence, in order to show (16. 5p . it suffices to prove 

[nt\ 



fc=l 



(6.7) 



We have 



sup 

te[o,T] 



U l ti4(l l m.> i 



fc=i 



0. 



1 L™*J ,3 1 L n *J 1 l™*J , 



k=l 

where 



k=l 



k=l 



sup 

te[o,T] 



n 3 ^ 1 3 



fe=i 



- l)(2lra*J - 1) -2n 3 t 3 | 
sup ~ ~ y 



te[o,T] 



6n 3 
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as n — > oo, hence, in order to show ( 16. 5p . it suffices to prove 

\nt\ \nT\ 

(6.8) - sup J2\ U k-k 2 (l,m £ ) 2 \ = — J2 \U 2 k -k 2 (l, m £ f 



0. 



For all fceN, by Remark I3.3[ (V^l, 1) = implies 

= -Xfc-1,1 + + + £fc,2 = £4-1 + (1, £fc), 

hence f4 = Xli=i(l) s «)- Applying Kolmogorov's maximal inequality, we obtain 



P 



(V 1 max \U k - k(l,m £ )\ > e] < rr 2 e" 2 Var([/ LnTJ ) = ^ Var((l, e^ 2 ) 
\ fce{i,...,Lnrj} / n z e z 



as ?i4oo for all e > 0, thus 

I IP 

n~ max 1 1/*; — k(l,m e )\ — > as n — > 00. 

k£{l,...,[nT}} 

We have 

\U 2 k - k 2 {l, m e } 2 \ ^\U k - k(l, m e }\ 2 + 2k(l, m E )\U k - k(l, m £ 

hence 



n~ max [/£ — k (l,m e r 

fce{i,...,LnTj} 1 fe x 7 



(n 1 max \U k — k(l, m e ) I ) 



2 ^ I ly-^J^ I 

^ I n" 1 max \U k - k(l, m e ) | ) H — (l,m e ) max \U k - k(l, m e )\ 

rr fc6{i,...,L"Tj} 



as n — >■ 00. Consequently 

\nT\ 



h E " (* " 'ftWl < f,.-™ - (*- i) 2 (i,»>.) 2 l A 

fc=l 

as n — > 00, thus we conclude ( 16. 8p . and hence (16.51) . 
Finally, we check flO]) . By (l5\40|) . 

|raij |n*J 

^ C/fe-x^xl 7 E(M fc Mj I JU) = ^ U k ^V k ^l T V £1 

k=l k=l 

hence using (IB.5P with £ — 2, i — 1, j — 1, we conclude (16.61) . 

Condition (ii) of Theorem ID. II can be checked as in case of Theorem 15.11 □ 
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7 Proof of Theorem 



This proof is also similar to the proof of Theorem 14.11 Consider the sequence of stochastic 
processes 



r(n) 



AT 



V 



(n) 



[nt\ 



: =E Z 



(-0 

A: 



with 



r(n) 



fc=l 



rT x M k 



for iGt + and Theorem 14.31 follows from Lemma IA.3I and the following theorem 

(this will be explained after Theorem 17. ip . 

7.1 Theorem. If (V^u,u) = then 

A Z 



(7-1) 



as n — > oo ; 



where the process (Z t ) t ^R + with values in I 2 x I 2 x 1 is i/ie unique strong solution of the 
SDE 



(7.2) 



dS t =7(*,^t) 



t E 



with initial value Zq = 0, where (Wt)t&R + o,nd (Wt)t&R + are independent standard Wiener 
processes of dimension 2 and 1, respectively, and 7 : M + x (M 2 x I 2 x 1) — > R 5x3 is defined by 



{l^x^tm^+Y^V 1 ^ 2 
(l : (x 1 + tm e )+) 3 / 2 v\ /2 

[(y^,S)E((u,£ 1 ) 2 )] 1/2 



for t e K+ and x = (x x , x 2 , x 3 ) 6l 2 xR 2 xl. 



As in the case of Theorem 14.11 the SDE (I7.2p has a unique strong solution with initial value 
Zq = 0, for which we have 













z t = 


Aft 




$ly s &M s 


te 




_v t _ 




[(V £ u,u)E((u,e 1 ) 2 )} 1/2 W t 





One can again easily derive 
(7.3) 



>(«)" 


V 


"x 




z {n) 




as n — > 00 




z 
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where 



X 



CO 



n 1 X\, 



\nt\ ■ 



X t :=-(l 7 Mt + tm e )l, te 



n G N. 



Next, similarly to the proof of ( 1A.6|) . by Lemma [C. 3 1 convergence (17. 3p and Lemma [A. 31 imply 

E«u,£i) 2 ) 

£y t d(i,Mt) 

l(V e u,u) E((u,e 1 ) 2 )] 1/2 W 1 



k=l 



n- 2 (l,M k )U k ^ 
n-V 2 {u,M k )V k - X 



v 



as n — y oo. 



Note that this convergence holds even in case E[(it, £i) 2 ] = 0. The limiting random vector can 
be written in the form as given in Theorem l4.31 since (1, X t ) = y t and (1, At*) = y t —(l, m £ t) 
for all t G K.+. 

Proof of Theorem 17.11 Similar to the proof of Theorem 15.11 The conditional variance 
E(Z k n) (Z k n) ) T | jF k _$ has the form 



n 2 V M , 



n 



rr 6 TJ k -{V Mk 
n- 3 U k ^V Mk n- A Ul_ 1 V Mh 



n- z ' 2 V k ^V Mk u 
n- 5 / 2 U k ^V k ^V Mk u 



for neN, fce{l,...,n}, with V Mk '= E{M k Mj \ .F fc _i), and 7 (s, Z^)j{s, Z^) T has 
the form 

(1, + sm £ )Vz (1, M.f ] + sm £ ) 2 F ? 
;i,Mi n) + sm £ ) 2 V ( (1,M^ + sm e ) 3 Vs 

(V e u,u)E((u,ei) 2 ) 

for s G R+. 

In order to check condition (i) of Theorem lD.il we need to prove only that for each T > 0, 

[nt\ 



(7.4) 
(7.5) 
(7.6) 



sup 

*6[0,T] 



fc=l 



\nt\ 



0. 



sup 

te[o,T] 



sup 

*e[o,T] 



fc=i 

LntJ 



J] C7 fc _ 1 y fc _ 1 u T E(M fe Mj | J'fc-i^ 



fe=i 



as n — > oo, since the rest, namely, ( 15. 5ft . (15. 6p and ( 15. 7p . have already been proved. 

Clearly, (V^u, u) = implies (V^u, u) = and (V^ 2 u, u) = 0. For each i G {1,2}, 
we have (V^.u,u) = u T V^.u = (V^ 2 u) T (V^ 2 u) = \\V^ 2 u\\ 2 , hence we obtain V^ 2 u = 0, 
thus V^.u = V\ /2 (V\ /2 u) = 0, and hence u T V ti = 0. 
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First we show (jT^|) . By f[5^7]) . 



\nt\ \nt\ 
k=l k=l 



hence, in order to show (17. 4ft . it suffices to prove 

[nt\ 



sup 

te[o,T] 



k=l 



0. 



For all k G N, by Remark [3. 3 1 (V^u, u) = implies 

Vfc = ^fc,l — -^fc,2 = E (^,3,1,1 — CkJ,l,2) + E (^.J. 2 ! 1 ~~ ^,i.2,2) + (£jfc,l — £fc,2) 



We have 



-^t-tE((S )£l ) 2 ) <- E[(^^-i) 2 -E((w,£ fc -i) 2 )] 
fc=i fe=i 



+ J^M1e«5, «»>'), 



n 



where |ni — [nt\ 1^1, hence, in order to show (17.41) . it suffices to prove 

[nt\ „ N 



(7.7) — sup 

n te[o,T] 



E[(S,6 fc ) 2 -E((S, £fc ) 2 )] 



fc=l 



1 

— max 

71 Ne{l,...,[nT\} 



k=l 



0. 



Applying Kolmogorov's maximal inequality, we obtain 



Pin 1 max 

Ne{l,...,[nT\} 



N 



E[(^£fc> 2 -E((£,£ fc ) : 



k=l 



1 f lnTi \ 



InTl „ 
- , Var((tt, e k ) 2 ) -» as rt ->■ 00 



for all e > 0, thus we conclude (17. 7p . and hence (]7.4p . 
Now we turn to check (17. 5p . By (I5.35p . 

\nt\ \nt\ 

fc=i fc=i 

Again by the strong law of large numbers, n -1 Ylh=L l^-il t¥,(\(u, £i)|) as n-yoo for 
all T > 0, hence we conclude ( 17.50 . 
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Finally, we check (173)1 . By flCTj) . 

[nt] |n*J 

^ f/fe-i^xn 1 " E(M fe M^ | J- fc _0 = ^ U k „ 1 V k - 1 u T V e . 

k=l k=l 

Applying again V k = (u,e k ), k G N, and Corollary IB.7[ we obtain E(|t4_iVfe_i|) ^ 
y / E(f/ fc 2 _ 1 )E(lf_ 1 ) = O(fc), which clearly implies f|7TB]i . 

Condition (ii) of Theorem ID. II can be checked again as in case of Theorem 15.11 □ 

Appendices 



A CLS estimators 



In order to find CLS estimators of the criticality parameter g = a + /3, we introduce a further 
parameter 5 := a — 0. Then a = (g + 5)/2 and (3 = (g — S)/2, thus the recursion (14.21) can 
be written in the form 



Xi 



g + 5 g — 5 
g — 5 g+ 5 



rn, 



keN. 



For each n G N, a CLS estimator (g n (X 1 , . . . , X n ),5 n (X 1 , . . . , X n )) of (f?, <5) based on a 
sample X±, . . . , X n can be obtained by minimizing the sum of squares 



J2\\X k -®(X k \F t 



k-lj 



k=l 



k=l 





Q 


+ 5 


Q ~ 


5 


X k -i - m £ 


x k 2 








6 


-5 


Q + 


5 



with respect to (g, 5) over M 2 . In what follows, we use the notation Xq := 0. For all n G N, 
we define the function Q n : (M 2 ) n xR 2 -il by 



Q n (xi, ...,x n ; g',5') : = ^ 



k=l 



X k 

2 



g' + 6' g'-5' 
g'-5' g' + 8' 



for all (g', 5') G K 2 and cci, . . . , x n G R 2 . By definition, for all n G N, a CLS estimator of 
(0, 5) is a measurable function (^ n , <5 n ) : (M 2 ) n — >■ M 2 such that 

Qn(X\, • • • , 3?nj f?ri(^l? • • • ? X n j, 5 n (x\, • • • , 3^n)) Vllf. Qn{x\i • • • , ; & ) 

(£>',<5')eK 2 



for all Xi, . . . ,x n el 2 . Next we give the solutions of this extremum problem. 
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A.l Lemma. For each n G N, any CLS estimator of (g,5) is a measurable function 
(g n ,5 n ) ■ (K 2 ) n M 2 for which 

ELii 1 '^ ~ m e )(l,aj i! _i) 



(A.l) 
(A.2) 



Qny^li ■ ■ ■ i X n j •" 
fin [X\i • • • i X n j •" 



on £/ie sei if n D given in (13. 2p and (13. 4p . 



Observe that flAlD and flA~2|) give natural CLS estimators of g and 5 on the set H n and 
if n , respectively. 

Proof of Lemma IA.ll The quadratic function Q n can be written in the form 

- / 1 1 \ 2 

Q n {xi, ...,x n ; g', S') = )( (e x , x k - m £ ) - ^g'{l, x k -i) - ^'{u, cc fe _i) J 

k=i ^ ' 
n ( 1 1 \ 2 

^ n n n 

= ^(dfY^^k-i) 2 - g'^2(l,x k - m e )<l,aj fc _i) + ^2(e 1 ,x k - m £ ) 2 

k=l k=l k=l 

- n n n 

+ -{5') 2S ^{u,x k ^i) 2 - 5'^2(u,x k - m £ ){u,x k -x) + ^(e 2 ,x k - m £ ) 2 , 

k=l k=l k=l 

where e.\ and e 2 denote the standard basis in R 2 , hence we obtain ( I A. Ill and ( 1A.2I) . □ 

One can easily check that any CLS estimator (a n , f3 n ) : (R 2 ) n — > M 2 of (a, f3) is of the 
form 

(A. 3) = — ^ Xi, . . . , x n G 



a n (x 1 , . . 


■ i x n ) 


1 


1 1 ~ 




g n (x 1 , . . 


■ ? X n ) 


J3n(xi, ■ ■ 


• j X n ) 


~ 2 


1 -1 




_5 n {Xii . . 


• j x n ) 



Namely, if ip : IR 2 — > M 2 is the bijective measurable function such that 



then there is a bijection between the set of CLS estimators of the parameters (a, (3) and the 
set of CLS estimators of the parameters ip(a, (3). Indeed, for all neN, x±, . . . , x n G M. 2 and 
K/T) GM 2 , 



'a' + p~ 




V" 






5' 



E 

k=l 



X k 



a' p 
0' a' 



x k ^ x - m e 



2 n 



E 

fc=i 



x k 



x k - X - ra e 
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hence (a n ,/3 n ) : M. n — > M 2 is a CLS estimator of (a, /3) if and only if ^(a n ,/? n ) is a CLS 
estimator of i/)(a,/3), and we obtain (1A.3[) . Hence this CLS estimator has the form 



(A.4) 



C^n \^Cl i • • • ■> 3Cn, 



0nO^lj • • • ) 3Cn) 



A n (x\, . . . , Xn) b n (X\^ • • • , X r 



on the set H n fl H n , where 



AniXij . . . , X 



k=l 



Indeed, by Lemma IA.lt 



II 

E 



fc=i 



^fc-1,2 ^fc-1,1 



a n (a;i, . 



• ) J 
1 ; «En) 



1 

2 



1 1 
1 -1 



f?n(^l) • • • ? 
^n(^l) • • • j •En) 



1 

2 



1 1 
1 -1 



-Fn(#l, 



9n ("^1 j • • • ; «^n) 5 



where 



k=l 



Qni.'Eli • • • ^ 



Fni&li ■ ■ ■ i «En) • ^ ^ 

n 



(l,^-i) 2 o 

(U,^^!) 2 



fc=l . 



l,asfc-i) 

(u,£C fe _i)_ 



(l,aj fc - m e ) 
{u,x k - m E )_ 



hence 





[x u . 




■i 


"l 1 " 




>i,.. 


• ? ^n) 




1 -1 



FniS^li ■ ■ ■ i *"n) 



1 


1 " 




-1 


"l 


1 " 


1 


-1 




1 


1 


-1 



Qni^li • • • j fn) 



which also shows the existence of A n (aJi, . . . , a; n ) _1 on the set H n r\H n . 

In order to analyse existence and uniqueness of these estimators in case of a critical doubly 
symmetric 2- type Galton- Watson process, i.e., when g = 1, we need the following approxi- 
mations. 



A. 2 Lemma. We have 

\fc=l y k=l / 
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Proof. In order to prove the satement, we derive a decomposition of ^22=i ^k as a sum °f a 
martingale and some negligible terms. Using recursion (I4.4p . Lemma [B. II and (1-4 . 5 p . we obtain 

E(U, 2 1 J- fc _x) = E [((a - 0)V h - X + (5, M fc + m £ » 2 1 .F fc _i] 

= (a - /3) V fe 2 _! + 2(a - /?)<«, m £ )V k -i + (u, m e > 2 + u T E(M k M T k \ JF k _ x )u 
= (a — f3) 2 V 2 _ 1 + ■u T (Xfc_i i iV^ 1 + Xfc„i j2 V^ 2 )tt + constant + constant x V k -\ 

= (a — P) 2 V 2 _ 1 + ^u T (V| 1 + V^JwC/fc-i + constant + constant x V k -\- 

Thus 

n n n 

E v ? = E W - *W i ^-o] + E *W i ^-o 
fc=i fe=i fc=i 



= E W - w i -^-0] + (« - z 3 ) 2 E ^-i + ^ T v ^ E u ^ 

k=l k=l k=l 

n 

+ 0(n) + constant x Vfc_i. 

fc=i 

Consequently, 

E ^ = E K - ^ i + T^kw {V * fi ' a> E ^ 

k=l v Ky fc=l v f ' k=l 

(A.5) 

- _/"_L k 2 + 0(n) + constant x V k-i- 
[a p) k=i 

Using (IB.7P with I = 8, i = and j = 2 we obtain 



1 n 



n 

k=l 



as n — > oo. 



By Corollary IB.7[ we obtain E(V^) = O(n), and hence n 2 V„ 2 — > 0. Moreover, 
n ~ 2 Sfc=i ^fc-i ~ as n oo follows by (IB. 51) with the choices £ = 8, % = 0, j = 1. 
Consequently, by ( 1A.5I) . we obtain the statement, since 1 — (a — (3) 2 = 4a (3. □ 

A. 3 Lemma. If (V^u, u) = then 

n 

n" 1 ^ U fe 2 E((u, £i) 2 ) as n -> oo ; 

k=l 

and E((w, £i) 2 ) = z/ and only if A fc l =' A fc 2 for all fcGN. 
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Proof. By Remark 13. 3[ (V^u, u) — implies 

3=1 3=1 

for all k G N, hence the convergence follows from the strong law of large numbers. Clearly 
E((w, £i) 2 ) = is equivalent to (u, £1) = £1,1 — £1,2 = 0, and hence it is equivalent to 
X k 1 - X k 2 =■ for all fceN. □ 



Now we can prove existence and uniqueness of CLS estimators of the offspring means and 
of the criticality parameter. 

A. 4 Proposition. We have lirn Tl _ KX) P((.X'i, . . . , X n ) G H n ) = 1, where H n is defined in 
( 13. 2p . and hence the probability of the existence of a unique CLS estimator g n (Xi, . . . , X n ) 
converges to 1 as n — > 00 , and this CLS estimator has the form given in (13.1 1) whenever the 
sample (Xi, . . . , X n ) belongs to the set H n . 

If (V^u, u) > 0, or if (V^u, u) = and E((u, e) 2 ) > 0, then ]xm n ^oo R{{Xi, • • • , X n ) G 
H n ) = I, where H n is defined in ( I3.4p . and hence the probability of the existence of unique 
CLS estimators 5 n (Xi, . . . , X n ) and (S n (Xi, . . . , X n ), f3 n (Xi, . . . , X n )) converges to 1 as 
n — > 00. The CLS estimator 5 n (Xi, . . . , X n ) has the form given in (13.51) whenever the sample 
(Xi, . . . , X n ) belongs to the set H n . The CLS estimator (a n (Xi, . . . , X n ), /3 n (X 1; . . . , X n )) 
has the form given in (I3.3P whenever the sample . . . , X n ) belongs to the set H n fl H n . 

Proof. Recall convergence X^ X = \yi from (13. lip . First we show 

< A -6) iE^-u + ^-J-^Ell^ll 2 ^ f\\x t f&t = \fyl&t 

k=l k=l Jo Jo 

as n — > 00. Let us apply Lemmas IC.2I and IC.3I with the special choices d := 2, p := q := 1, 
h : R 2 -* R, h{x) :=x, x G R 2 , K : [0, 1] x R 2 x R 2 -> R, 

K(s, x, y) := \\x\\ 2 , (s, x, y) G [0, 1] x R 2 x R 2 , 

and U := AT, W (n) := X (n \ n G N. Then 

|Zf(s, jc, 2/) - u, u)| = |||«|| 2 - || -ix || 2 1 ^ (||£c|| + ||w||)| ||a;|| - ||it||| 

< 2R(\t -s\ + \ \\x\\ - \\u\\\ \ ^ 2R(\t-s\ + \\(x,y) - (u,«)||) 

for all s,tG [0,1] and (x, y), (u, v) eR 2 x R 2 with \\(x,y)\\^R and ||(w, v)|| < R, where 
R > 0. Further, using the definition of $ and $ n , n G N, given in Lemma [C. 3 1 



•.(*«) = (*?>, ±E Kill 2 ) = (V-4x>*i 12 

V fc=l / \ k=l 



$(X) =[x 1 , \\X u \\ z du 



1 

2 
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Since the process (X t )t£R + admits continuous paths with probability one, Lemma [C.2I (with 
the choice C := C(K+,R)) and Lemma [Cj yield flX6|) . Since m £ ^ 0, by the SDE flUJ) , 
we have ¥{y t = 0, t e [0, 1]) = 0, which implies that P^ 1 3> t 2 dt > 0) = 1. Consequently, 
the distribution function of J* y 2 dt is continuous at 0, and hence, by (IA.6I) . 

p^<i,x fe _i> 2 >oj =p^El|x fc _ 1 f>oj^pQ^ 1 ^ 2 dt>o^) =1 

as n — > oo. 

Now suppose that (V^u, u) > holds. In a similar way, using Lemma IA.21 convergence 
(13. lip , and Lemmas 10.21 and 10.31 one can show 



n 1 ^ Aa(3 J 



dt as n — > oo, 



implying 



hence we obtain the statement under the assumption (V^it, it) > 0. 
Next we suppose that ( V^u, u) = and E((u, e) 2 ) > hold. Then 

P f |>, X fc _ x ) 2 > J = P f i g ^-i > J -+ !' 

since Lemma [A. 3 1 yields n~ l Y^l=i ^k-i Si) 2 ) > 0, and hence we conclude the 

statement under the assumptions (V^u, u) — and E((u, e) 2 ) > 0. □ 



B Estimations of moments 

In the proof of Theorem 13. 1\ good bounds for moments of the random vectors and variables 
(M fc ) fc6Z+ , (X k ) k&+ , (U k ) keZ+ and (V k ) k&+ are extensively used. First note that, for all 
keN, E(M k | JFk-i) = and E(M fc ) = 0, since M fc = X fc - E(X k \ T k -\)- 

B.l Lemma. Let (X k ) k& z + be a 2-type doubly symmetric Galton-Watson process with im- 
migration and with X = 0. If E(||£ 1):Lil || 2 ) < oo ; E(||^ llj2 || 2 ) < oo and E(||£i|| 2 ) < oo 
then 

(B.l) E(M k M T k | = X k . 1A V^ + X k ^ 2 V^ 2 + V e , ke N. 

V E (ll£i,i,i|| 3 ) < E (ll^i,i,2l| 3 ) < oo Edlexf) < oo then, for all keN, 

E(Mf | 7-^0 = E[(^ 111 - E(£ 1;L1 )® 3 ] 

(B.2) 

+ X fc _ li2 E[(^ lil>2 - E(| 1;li2 )® 3 ] + E[( Sl - E( Sl )® 3 ]. 
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Proof. By flUE]) and (jO) . 

(B.3) M fc = ]T (^-1(^.0)+ (^, 2 -E(^ Jl2 )) + (s fe -E(£ fc )), ^N. 

J=l 3=1 

For all fceN, the random vectors {£ kjl -E^.J, ^.2-^(^,2). £ fc -E(e fc ) :j'eN} are 
independent of each other, independent of J^k-i, and have zero mean vector, thus we conclude 
flRTf and (JR2]). □ 

B.2 Lemma. Let (^ k )k^n be independent and identically distributed random vectors with 
values in M. d such that E(||<^ 1 || £ ) < 00 with some leN. 

(i) Then there exists Q = (Qi, . . . , Qd l ) '■ R , where Q\, . . . , Q^t are polynomials 
having degree at most £ — 1 such that 

E{(C 1 + --- + t N r)=N e [E(t 1 )]® e + Q(N), NeN, N > £. 

(ii) If E(^ x ) = then there exists R = (Ri, ■ ■ ■ , Rs) : M — >• R , where R\, . . . , R d i are 
polynomials having degree at most [£/2\ such that 

E((Ci + --- + Cjv)®0 =R(N), NeN, N>L 

The coefficients of the polynomials Q and R depend on the moments E(^ il ® ■ ■ ■ (g) £ 4 ), 
ii,...,z* e {l,...,iV}. 

Proof, (i) We have 

-(«. + - + c,n- E ffl(V)-r"* , V"^) 

s e{i,...,£},fci,...,fc s ez+, \ v \ ^ / \ s / 

fcl+2fc 2 H — hsfc s =^, fc s ^o 

where the set Pff*'* k consists of permutations of all the multisets containing pairwise different 
elements jki,---,jk s of the set {1,...,N} with multiplicities ki,...,k s , respectively. Since 

N\ (N - JfcA (N - h fc s A N(N — l)---(N — k 1 — k 2 k s + l) 



hj\ h J \ k s J fci!fc 2 ! • ■ • k s \ 

is a polynomial of the variable N having degree k\ + ■ ■ ■ + k s ^ £, there exists P = 
(Pi, . . . , Pje) : K — > M. d * , where Pi, . . . , P^i are polynomials having degree at most £ such 

that E((£ x + - ■ - + Cv) ^) = P{N). A term of degree t can occur only in case k±-\ \-k s — £, 

when ki + 2k 2 + ■ ■ ■ + sk s = £ implies s = 1 and k\ = £, thus the corresponding term of 

r 1 ®& 

degree £ is N(N — 1) • • • (N — I + 1) [E^-jJ , hence we obtain the statement. 
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(ii) Using the same decomposition, we have 

■«—<->•>=„ ,£_©(".-,'■)■ r'T-'™) 

2k2+3k 3 +-+sk 3 =e, k 3 ^0 

Here 

'iV\ fN-k 2 \ (N -k 2 fc s A iV(iV - 1) • • • (N - k 2 - k 3 k s + 1) 



,V \ h J \ h J k 2 \k 3 \---k s \ 

is a polynomial of the variable N having degree k 2 + ■ — h k s . Since 

I = 2k 2 + 3k 3 + ■ ■ ■ + sk s ^ 2(A; 2 + ^3 + • • • + k a ), 

we have k 2 + ■ ■ ■ + k s $C £/2 yielding part (ii). □ 

B.3 Remark. In what follows, using the proof of Lemma we give a bit more explicit form 
of the polynomial Ri in part (ii) of Lemma IB. 41 for the special cases I — 1, 2, 3, 4, 5, 6. 

E(d + --- + Cv) = 

E((C 1 + --- + CArD=iVE(Cf 2 ). 

E((d + ■ ■ ■ + CvD = iVE(Cf) + N{N ~ 1} £ E(C il ® < ia ® C i3 ® CJ- 



I- ■ ■ ■ \r- dW 4 ) 
(H,l2,J3,l4)eP 2 



E((d + ■ • • + CvD = NE(Cf) + iV(iV - 1) £ E(C n ® C 2 ® C, 3 ® C, 4 ® CJ- 



(n,«2,«3,i4,i5)eP (J ^'f :i 



E((Ci + --- + C 



A' z 1 



iVE(Cf) + N(N - 1) £ E(C n ® C i2 ® C, 3 ® C i4 ® C i5 ® C* 

(il|t2,i3)*4,*S)»8)e-Po^'o,\ 

MAT- 1) ^ . , 

+ — - 2^ E^ ® c i2 ® C i3 ® C i4 ® C i5 ® C ie ) 



(il,j2,«3,«4,i5 i i6)6-Po, J 0,'2'' 



iV(iV- l)(iV- 2) 

+ — — E E(c tl ®c 42 ®c 3 ®c t4 ®c 5 ®c 



3! 

(il,i2,i3,*4,j5,«6)ePQ^' 6) 

□ 
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Lemma IB.2I can be generalized in the following way. 



B. 4 Lemma. For each j G N, let (Cjfc)fceN be independent and identically distributed random 
vectors with values in R d such that E(||CiilD < 00 with some ^GN. Let jx, . . . G N. 



(i) Then there exists Q = (Qi, . . . , Q 



d' , 



—> R , where Q\, . . . , Q$l are polynomials 



of £ variables having degree at most £ — 1 such that 



for Ni,.. 

(") // E(C il(1 
Ri, . . 



■ ■ ■ ® (c*,! + ■ • • + c^)) 

= N\...Nt E(C il , 1 ) <8> ■ • • <8> E(C jt ,i) + Q{N X , ...,N, 
N e eN with Ni ^ £, . . . , N e ^e. 

= . . . = E(£ = then there exists R = (Ri, . . . , R d i) : 



, where 



. , R d i are polynomials of £ variables having degree at most [£/2\ such that 

E((c h ,i + ■■■ + C juNl ) ® ■ ■ ■ ® (C^i + ■ • • + C hM )) = R(Nt, ...,N t ) 
for Ni, ...,JVf GN with N x ^i, N £ ^£. 

The coefficients of the polynomials Q and R depend on the moments E(^ J - 1 4l <S> • • • <S> C# i e ) 

i x e {l,...,^}, ...,i e e{l,...,N £ }. 



B.5 Lemma. If (a, /3) G [0,1] with a + j3 — 1, i/ien #ie matrix defined in (12. 4p /ias 

eigenvalues 1 and a — /3 ; and i/ie powers of take the form 



1 1 
1 1 



+ -(a-/3)'" 



1 -1 
-1 1 



jGZ H 



Consequently, ||m||| = 0(1), ie. ; sup JgN ||m^|| < 00. 



Proof. The formula for the powers of follows by the so-called Putzer's spectral formula, 
see, e.g., Putzer [12]. □ 



B.6 Lemma. Let (Xk)k£Z + be a 2-type doubly symmetric Galton-Watson process with im- 
migration with offspring means (a, (3) G [0,1] such that a + /3 = 1 (hence it is critical). 
Suppose X = 0, and E(||^ 111 || € ) < oo, E(||^ 112 ||^) < oo ; E(||ei||^) < 00 with some 
IGN. Then E(||X fe f ) = 0(A; f j ; ' i.e., sup fceN k~ e E(||X fe ||^) < 00. 

Proof. The statement is clearly equivalent with E(P(Xfe ) i, ^,2)) ^ cpk e , k G N, for all 
polynomials P of two variables having degree at most £, where cp depends only on P. 

If £ = 1 then (I2.3P and Lemma IB .51 imply 



fc-i 

E{X k ) = Y, m \ m e 

j=0 





1 1 




1 1 



1 - (a-PY 
4^ 



1 -1 
-1 1 



m £ , k G N, 
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which yields the statement. 
By (O, 



(B.4) 



Xfc-1,1 \ / ^fe-1,2 \ / \ / ^fe-1,2 

E + E ^ + e f + E ^ E 

E ^ k >h 2 
-Yfe-1,2 \ / Xk 



Xk-i,i \ / ^fc-i,i \ / ^"fc-i.i 

E + ( E ^ ( E 



+ E ® £fc + £k ®\ E 



3=1 



i=i 



Since for all fceN, the random variables • 1; £fc ,-3, e k '■ 3 ^ are independent of each 
other and of the cx-algebra J^k-i, we have 



E(XP|^ k _ 1 ) = E( (E^M 



+ e ((e^ 2 ) 



+ E(ef ) 



+ E (E^i ® E E^>2 

o=i / \j=l 



A' 



M 



M=X k _ 
JV=X fc _i, a 



+ E (E^i 

,i=i 



,i=i 



/ M ^ 

E(e fc )+E(e n )<g)E E^M 



Af=Xfe-i,i 



M=X k _ 



N 



+ E (E^ 

o=i 



N 



®E(e fc )+E(e fc )(8)El E^',2 

N=X h - 1 n Vi = l 



M=X k . 



N=Xu 



Using part (i) of Lemma TB .41 and separating the terms having degree 2 and less than 2, we have 



= X^^raf 2 + X£_ 12 m| 2 + X fc _ lil X fc _ li2 (m €i <g> + rn^ ® m €l ) + Q 2 (X fe _i,i, X fc _ 1>2 ) 

= (^-i,i m ^ + Xfc.x^m^J 02 + Q 2 (X/._i ) i, Xfc_i ;2 ) = (m^X fc „x)® 2 + Q 2 (X fc _ lil; X fc _ lj2 ) 

= m^Xf^ + Q 2 (Xfc_i,i, Xfc_i j2 ), 

where Q 2 = ((?2,i, Qi,v, <?2,3, Q24) : ->■ K 4 , and Q 2 ,i, <?2,2, <?2,3 and Q 2 ,4 are polynomials 
of two variables having degree at most 1. Hence 



E(Xf 2 ) = mf 2 E(Xf 2 1 ) +E[Q 2 (X fc _ 1 , 1 ,X fc _ 1 , 2 )]. 



In a similar way, 



E(Xf ) = mf E(X^ X ) + E[Q,(X fe _ 1 , 1 ,X fe _ 1 , 2 )], 
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where Q e = (Qe,i, • • • , Qipi) '■ ^ 2 — * ^ \ an d Qe,i, ■ ■ ■ , Qe,2 e are polynomials of two variables 
having degree at most £ — 1, implying 

k k-l 

E(Xf) = X)(mf ) fe ^E[Q,(X,-_ 1)1 ,X i _ 1)2 )] = £(mf )^'E[Q,(X fe _ j _ 1 , 1 ,X fe _ j _ li2 )] 
i=i i=o 
fe-i 

= ^(mj)® 4 E[Q < (X fc _ i _i,i,X fc _ i _i, 2 )]. 
i=o 

Let us suppose now that the statement holds for 1, ...,£ — 1. Then 

EfQ^pf^!,!, X^La)] < cq^^" 1 , k G N, z G {1, . . . , 2 £ }. 

Lemma lB.51 clearly implies ||(m^)® £ || = 0(1), i.e., sup JgN || (m^)® £ || < oo, hence we obtain 
the assertion for £. □ 

B.7 Corollary. Let (X k ) k& z + be a 2-type doubly symmetric Galton-Watson process with 
immigration with offspring means (a, 0) G (0, l) 2 such that a + f3 = 1 (hence it is critical and 
positively regular) . Suppose X = 0, and E(||£ 1:L1 || ) < oo, E(||£ 112 || ) < oo ; E(||£i|| £ ) < oo 
with some £ G N. Then 

E(\\X k \f) = 0(k e ), E(Mf ) = 0(£^ /2j ), E(U £ k ) = 0(k e ), E(V k 2j ) = 0(k j ) 

for j G Z+ with 2j ^£. 

Proof. The first statement is just Lemma [B.6I Next we turn to prove E(JW® ) = 0(/c^/ 2 J). 

Using flB.31) . part (ii) of Lemma EH and that the random vectors {£k,j,i ~~ £fc,j.2 ~~ 

E(£ fe - 2 ), Sfc — E(efc) : j G N} are independent of each other, independent of J^-i, and have 
zero mean vector, we obtain 

E(Mf e | J* fc _i) = R(X k - h i,X k - h2 ), 

with = (Ri, . . . , i? 2 £ ) : where . . . , R 2 t are polynomials of two variables 

having degree at most £/2. Hence 

E(Mf)=E(Jl(X fc _i i i J X fc _i, 2 )). 

By Lemma EH we conclude E(Mf) = 0(A;L £ / 2 J). 

Lemma E6] implies E(t/|) = E[(X M + Xy) 4 ] = 0(A; £ ). 

Finally, for j G Z + with 2j $C we prove E(V fc 2 "') = 0(/c J ) using induction in fc. By the 
recursion 14 = (a-/3)V k _ 1 +(u, M k +m e ), k G N, we have E(T4) = (a-/3) E(T4_i)+(u, m e ), 
k G N, with initial value E(Vo) = 0, hence 

k-l 



E(V k ) = (u,m e )J2(®-f3)\ k eN, 



i=0 
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which yields E(|V fe |) = 0(1). Indeed, for all k G N, 



k-l 



i=0 



1- \a-(3\ 



The rest of the proof can be carried out as in Corollary 9.1 of Barczy et al. jl]. 
The next corollary can be derived exactly as Corollary 9.2 of Barczy et al. [I]. 



□ 



B.8 Corollary. Let (X fc ) fceZ+ be a 2-type doubly symmetric Galton-Watson process with 
immigration with offspring means (a, (3) G (0, l) 2 such that a + (3 = 1 (hence it is critical and 
positively regular) . Suppose X = 0, and E(||^ ljl]1 || £ ) < oo, E(||£ ljl]2 || £ ) < oo, E(||ei|| ) < oo 
with some i G N. Then 

(i) for all i,j G Z + with max{i, j} ^ [£/2\, and for all k > i + | + 1, we have 

n 

(B.5) n~ K \ u l v k \ «« n->oo, 



fc=i 



(ii) for all i,j G Z + w«£/i max{i, j} ^ for all T > 0, and for all k > i + | + ^jr-, we 



(B.6) 



~ K sup l^jV^jl 
te[o,T] 



as n — >■ oo, 



(hi) /or a// z, j G Z + wi/i max{z,j} ^ [£/4j , /or a// T > 0, and for all k > i + | + 5? 



toe /iai>e 
(B.7) 



n sup 

te[o,T] 



LniJ 



fc=i 



os n-foo. 



B.9 Remark. In the special case £ = 2, % = 1, j = 0, one can improve (IB.6j) . namely, one 
can show 



(B.8) 

see Barczy et al. jl]. 



n K sup U\nt\ — > as n — > 00 for k > 1, 

te[o,T] 



C A version of the continuous mapping theorem 

A function / : M + — > M d is called cddldg if it is right continuous with left limits. Let 
D(M + , R d ) and C(M + ,R d ) denote the space of all M. d - valued cadlag and continuous functions on 
M + , respectively. Let <B(D(R + , M d )) denote the Borel a-algebra on D(M + ,IR d ) for the metric 
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defined in Jacod and Shiryaev |8] Chapter VI, (1.26)] (with this metric D(R + , ~R d ) is a complete 
and separable metric space and the topology induced by this metric is the so-called Skorokhod 
topology). For Revalued stochastic processes (yt)tm+ an d (y[ n>> )t£R + , nEN, with cadlag 
paths we write y (n) ^ y if the distribution of y {n) on the space (D(R+, R), B(D(R+, R d ))) 
converges weakly to the distribution of y on the space (D(R + , R), i3(D(R + , R d ))) as n — > oo. 
Concerning the notation — > we note that if £ and £ n , nGN, are random elements with 
values in a metric space (E,d), then we also denote by £ n — > £ the weak convergence of 
the distributions of £ n on the space (E, 13(E)) towards the distribution of £ on the space 
(E, 13(E)) as n — > oo, where 13(E) denotes the Borel cr-algebra on E induced by the given 
metric d. 

The following version of continuous mapping theorem can be found for example in Kallen- 
berg j9j Theorem 3.27]. 

C.l Lemma. Let (S,ds) and (T,d?) be metric spaces and (£ n )neN; £ be random elements 
with values in S such that £ n — > £ as n — >■ oo. Let f : S — > T and / n : 5 — > T, n6N, fre 
measurable mappings and C G 6(5) suc/i inai P(£ G C) = 1 and lim^oo dr(/n(sn), f(s)) = 
i/ lim^oo d s (s n , s) = and seC. Then f n (£ n ) — > /(£) as n oo. 

For the case 5 = D(R + ,R d ) and T = R 9 (or T = D(R + , R 9 )), where d, q G N, we 
formulate a consequence of Lemma IC.ll 

For functions / and f n , n G N, in D(R + ,R d ), we write f n —> f if (f n )neN 
converges to / locally uniformly, i.e., if sup t£ r 0T i ||/ n (*) — f(t)\\ ~~ as n ~ * 00 f° r an 
T>0. For measurable mappings $ : D(R+, R rf ) A- R 9 (or $ : D(R + , R d ) -> D(R+, R 9 )) and 
$ n : D(R+,R d ) ->■ R 9 (or $ n : D(R+,R d ) -> D(R + ,R 9 )), n G N, we will denote by C*,(* n ) BeN 
the set of all functions / G C(R+,R d ) such that $ n (/ re ) $(/) (or $ n (/ n ) $(/)) 
whenever f n -^f with /„ G D(R + , R d ), n G N. 

We will use the following version of the continuous mapping theorem several times, see, e.g., 
Barczy et al. [21 Lemma 4.2] and Ispany and Pap [HI Lemma 3.1]. 

C. 2 Lemma. Let d, g G N, and (W t )teR + and (jU[ )teu + , n6N, be M. d -valued stochastic 
processes with cadlag paths such that U {n) U. Let $ : D(R + ,R d ) ->■ R 9 (or $ : 
D(R + ,R a! ) D(R + ,R 9 ); and $ n : D(R + ,R d ) -»■ R 9 for $„ : D(R + ,R d ) -»■ D(R + ,R 9 )/, 
ti£N, be measurable mappings such that there exists C C C*,(*»0neN with C G i3(D(R + ,R rf )) 
and F(U G C) = 1. Then § n (U (n) ) A $(W). 

In order to apply Lemma IC.21 we will use the following statement several times, see Barczy 
et al. jH Lemma B.3]. 

C.3 Lemma. Let d, p, q G N , h : R d — »■ R 9 6e a continuous function and K : [0, 1] xR 2fi — >■ R p 
&e a function such that for all R > i/iere exists Cr > suc/i inat 

(C.l) \\K(s, x) - K(t, y)\\ *C C fl (|t - s| + ||x - y||) 
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for all s,t G [0, 1] and x,y G Mr with \\x\\ R and \\y\\ i?. Moreover, let us define the 



mappings $, $„ : D( 



H-> ■ 



M q+P , neN, by 



•.(/)== (w<i)),|i>g,/g),/( 



fc- 1 



r? 



/or a// / G D( 



a 



$,(*")n61* 



C( 



*(/):= (M/(l)),y A-(«,/(ti),/(ti))d« 

L + ,R d ). T/ien i/ie mappings $ and $ n , n G N, are measurable, and 
f ,R d ) G £(D(M + ,M d )). 



D Convergence of random step processes 

We recall a result about convergence of random step processes towards a diffusion process, see 
Ispany and Pap [6]. This result is used for the proof of convergence ( 15. II) . 



D.l Theorem. Let 7 : 



x 



idXT 



be a continuous function. Assume that uniqueness 



in the sense of probability law holds for the SDE 
(D.l) dU t = 1 (t,Ut)dW t , t G R+, 

with initial value IAq = u for all u G M d , where {Wt)teR+ 
Wiener process. Let (U t )tm+ be a solution of (ID.lj) with initial value 1Aq = G M d . 

For each n G N, let (U^)km be a sequence of d- dimensional martingale differences with 
respect to a filtration (J^ n) ) feeZ+ , i.e., E(U { ^ | =0, neN, fc G N. lei 



is an r-dimensional standard 



U 



(n) 



[nt\ 
k=l 



(n) 
fc ' 



t G 



n G N. 



Suppose that E(\\U^ ] \\ 2 ) < 00 for all n, fc G N. Suppose that for each T > 0, 



LntJ 



E E(c/^(£4 n) ) T 1 - J t 7 ( S) WW) 7 ( Sl WW)Td S 



(1) sup 

te[o,T] 

W EE(||17W|| 2 l {r w M |j^) AO for all 9 > 0, 



0, 



where denotes convergence in probability. Then 14^ tl as n — > 00. 

Note that in (i) of Theorem ID.lt II ' II denotes a matrix norm, while in (ii) it denotes a 
vector norm. 



11 



References 



Athreya, K. B. and Ney, P. E. (1972). Branching Processes, Springer- Verlag, New 
York-Heidelberg. 

Barczy, M., Ispany, M. and Pap, G. (2010). Asymptotic behavior of CLS estimators 
of autoregressive parameter for nonprimitive unstable INAR(2) models. Available on the 
ArXiv: http : //arxiv . org/abs/1006 . 4641. 

Barczy, M., Ispany, M. and Pap, G. (2011). Asymptotic behavior of unstable INAR(p) 
processes. Stochastic Process. Appl. 121(3) 583-608. 

Barczy, M., Ispany, M. and Pap, G. (2012). Asymptotic behavior of CLS estimators 
for unstable INAR(2) models. 

Available on the ArXiv: http://arxiv.org/abs/1202.1617. 

Hamilton, J. D. (1994). Time series analysis. Princeton University Press, Princeton. 

Ispany, M. and Pap, G. (2010). A note on weak convergence of step processes. Acta 
Mathematica Hungarica 126(4) 381-395. 

Ispany, M. and Pap, G. (2012). Asymptotic behavior of critical primi- 
tive multi-type branching processes with immigration. Available on the ArXiv: 
http : //arxiv . org/abs/ 1205 . 0388. 

Jacod, J. and Shiryaev, A. N. (2003). Limit Theorems for Stochastic Processes, 2nd 
ed. Springer- Verlag, Berlin. 

Kallenberg, O. (1997). Foundations of Modern Probability. Springer, New York, Berlin, 
Heidelberg. 

Kesten, H. and Stigum, B. P. (1966). A limit theorem for multidimensional Galton- 
Watson processes. Ann. Math. Statist. 37(5) 1211-1223. 

Musiela, M. and Rutkowski, M. (1997). Martingale Methods in Financial Modelling, 
Springer- Verlag, Berlin, Heidelberg. 

Putzer, E. J. (1966). Avoiding the Jordan canonical form in the discussion of linear 
systems with constant coefficients. The American Mathematical Monthly 73(1) 2-7. 

Quine, M. P. (1970). The multi-type Galton- Watson process with immigration. J. Appl. 
Probab. 7(2) 411-422. 

Revuz, D. and Yor, M. (2001). Continuous Martingales and Brownian Motion, 3rd ed., 
corrected 2nd printing. Springer- Verlag, Berlin. 

Tanaka, K. (1996). Time Series Analysis, Nonstationary and Noninvertible Distribution 
Theory. Wiley Series in Probability and Statistics. John Wiley & Sons, Inc., New York. 



12 



[16] Wei, C. Z. and Winnicki, J. (1989). Some asymptotic results for the branching process 
with immigration- Stochastic Process. Appl. 31(2) 261-282. 

[17] Wei, C. Z. and Winnicki, J. (1990). Estimation of the means in the branching process 
with immigration. Ann. Statist. 18 1757-1773. 

[18] Winnicki, J. (1991). Estimation of the variances in the branching process with immigra- 
tion. Probability Theory and Related Fields 88(1) 77-106. 



13 



